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(54) Pointing device for digital camera display 

(57) A process and apparatus is described to im- 
pove a digital camera user interface and increase ease 
of use and functionality of a digital camera (100) by 
quickly, accurately and robustly permitting cursor con- 
trol and designation in a digital camera display (160). A 
digital camera (100) is used as a pointing device such 
asamouse or trackball. The motion of thecamera (100) 
is detected (130), and the motion of the camera is used 
to position graphic elements on the camera's own dis- 
play (1 60). The camera's motion can be detected (1 30) 
with sensors, such as gyroscopes, or the camera (1 00) 
itself can be used as a motion sensor. One application 
of this involves using the camera (100) as a computer 
mouse, or like a gun-sight, to select images from a sheet 
of low-resolution ("thumbnail") images. The motion of 
the camera (100) is tracked, and the user aims at the 
desired image from a sheet of thumbnail images. The 
thumbnails appear to be fixed relative to the world be- 
cause the camera (100) can continuously reposition 
them in the display (160) based upon the motion of the 
camera (100). The user can then select (170) a thumb- 
nail in an intuitive manner by simply pointing the camera 
(100) at the desired thumbnail. For alternative embodi- 
ments, the interface can be used to select (1 70) regions 
of greater extent than can be viewed in the viewer or to 
virtually review images. 
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Description 

Background of the Invention 

1. Field of the Invention 5 

[0001] The present invention relates to digital camer- 
as and, more particularly, to a pointing device-based 
graphical user interface that uses the camera display, 

2. Description of the Related Art 

[0002] Digital cameras have not generally used point- 
ing devices to interact with the interface presented on 
the display. Typically, they use a set of push buttons to 15 
step through menus and to select images from memory 
for display and deletion. New digital cameras may rely 
on micro display devices, instead of the now more com- 
mon panel display. To view a micro display, the user 
needs to hold the display close to his or her eye and 20 
view the display through an eyepiece. This arrangement 
makes the interface controls more difficult to use, be- 
cause the user will not be able to see the controls while 
viewing the display. 

[0003] United States Patent 5,808,678, Yuji Sakaegi, 25 
entitled "Method and Apparatus for Designing a Position 
on a View Finder Based on Motion Detection", which is- 
sued September 15, 1998, describes the use of a 
switch, trackball, joystick or camera-motion controlled 
cursorto interact with the interface presented on a digital 30 
camera display. In the case of the switch, trackball or 
joystick, it is awkward to designate locations or icons 
when looking through the camera veiwfinder because 
the user must hold the camera while manipulating the 
controls. In the latter case, the motion of the camera is 
used to move the cursor about the viewfinder interface 
and select icons therein. This interface is also awkward 
to use, however, because the motion causes the cursor 
to wander around the viewing area in an unintuitive way. 
[0004] Thus, it can be seen that modern user interface 
techniques impose ease of use and functionality limits 
upon digital cameras, and hinder the use of these cam- 
eras in many applications. 

[0005] Therefore, there is an unresolved need for ah 
improved user interface technique that can increase dig- 
ital camera ease of use and functionality by quickly, ac- 
curately and robustly permitting cursor control and des- 
ignation in a digital camera display. 

SUMMARY OF THE INVENTION 

[0006] A process and apparatus is described to im- 
prove a digital camera user interface and increase ease 
of use and functionality of a digital camera by quickly, 
accurately and robustly permitting cursor control and 
designation in a digital camera display. 
[0007] A digital camera is used as a pointing device 
such as a mouse or trackball. The motion of the camera 
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is detected, and the motion of the camera is used to po- 
sition graphic elements on the camera's own display. 
The camera's motion can be detected with sensors, 
such as gyroscopes, or the camera itself can be used 
as a motion sensor. One application of this involves us- 
ing the camera as a computer mouse , or like a gun-sight, 
to select images from a sheet of low-resolution ("thumb- 
nail") images. The motion of the camera is tracked, and 
the user aims at the desired image from a sheet of 
thumbnail images. The thumbnails appear to be fixed 
relative to the world because the camera can continu- 
ously reposition them in the display based upon the mo- 
tion of the camera. The user can then select a thumbnail 
in an intuitive manner by simply pointing the camera at 
the desired thumbnail. 

[0008] For alternative embodiments, the interface can 
be used to select regions of greater extent than can be 
viewed in the viewer or to virtually review images. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] The invention will be readily understood by the 
following detailed description in conjunction with the ac- 
companying drawings, wherein like reference numerals 
designate like structural elements, and in which: 

Figure 1 is a block diagram illustrating a pointing 
device-based graphical user interface system for a 
digital camera display according to the present in- 
vention; 

Figure 2 is a diagram illustrating a digital imaging 
system having a pointing device-based graphical 
user interface camera according to the present in- 
vention; 

Figures 3a and 3b illustrate use of the camera as a 
pointing device to select thumbnail images accord- 
ing to an embodiment of the present invention; 
Figure 4 is a diagram illustrating how the thumbnail 
images of Figures 3a and 3b are made to appear to 
be motionless relative to objects of the scene; 
Figures 5a and 5b illustrate use of the camera as a 
pointing device to select a portion of the scene larg- 
er than the viewfinder according to an embodiment 
of the present invention; 

Figure 6 is a diagram illustrating heads-up display 
of status information according to an embodiment 
of the present invention; 

Figure 7 is a diagram illustrating use of heads-up 
data during a guided swipe of a panoramic scene 
according to an embodiment of the present inven- 
tion; 

Figure 8 is a diagram illustrating tracking during vir- 
tual review of the panoramic scene according to an 
embodiment of the present invention; 
Figure 9 is a diagram illustrating image manipula- 
tion according to an embodiment of the present in- 
vention; and 

Figures 10a and 10b illustrate use of the camera as 
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a pointing device to select thumbnail images for 
high resolution page layout according to an embod- 
iment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 5 

[0010] Embodiments of the invention are discussed 
below with reference to Figures 1-1 Ob. Those skilled in 
the art will readily appreciate that the detailed descrip- 
tion given herein with respect to these figures is for ex- 10 
planatory purposes, however, because the invention ex- 
tends beyond these limited embodiments. 
[0011] The invention described here allows a digital 
camera to be used as a pointing device such as a mouse 
or trackball. The motion of the camera is detected, and *s 
the motion of the camera is used to position graphic el- 
ements on the camera's own display. The camera's mo- 
tion can be detected with sensors, such as gyroscopes, 
or the camera itself can be used as a motion sensor. 
One application of this involves using the camera as a 20 
computer mouse, or like a gun-sight, to select images 
from a sheet of low-resolution ("thumbnail") images. The 
motion of the camera is tracked, and the user aims at 
the desired image from a sheet of thumbnail images. 
This application is illustrated in greater detail below in 25 
connection with figures 3a, 3b and 4. 
[001 2] Figure 1 is a block diagram illustrating a point- 
ing device-based graphical user interface system for a 
digital camera display according to the present inven- 
tion. In digital camera 1 00, an image is captured by im- 30 
age capture unit 110. The image capture unit 110 can 
be selected from among the many such devices known 
in the art. Preferably, image capture unit 110 will be ei- 
ther a CCD or CMOS imaging device, as is commonly 
used for image sensing in modern digital cameras. 35 
[001 3] One or more of a series of images captured by 
image capture unit 1 1 0 will be stored at least temporarily 
in memory 120. For one embodiment of the present in- 
vention, motion detection unit 1 30 uses the changes be- 
tween subsequent images to calculate an amount and 40 
direction of motion for camera 100. There are many 
techniques known in the art for calculation of motion 
based upon changes in captured images. One such 
method is described in United States Patent 5,808,678, 
Yuji Sakaegi, entitled "Method and Apparatus for De- *s 
signing a Position on a View Finder Based on Motion 
Detection", which issued September 15, 1998. Another 
such method is described in United States Patent 
5,786,804, Gary B. Gordon, entitled "Method and Sys- 
tem for Tracking Attitude", which issued July 28, 1998. so 
[0014] Note that, although the system of Figure 1 
teaches the use of one image capture unit 110, for an 
alternative embodiment, a first image capture unit can 
be used for capture of the digital picture taken by the 
camera and separate image capture unit can be used 55 
for the motion detection. 

[0015] Also note that, for another embodiment of the 
present invention, motion detection is not performed op- 
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tically by comparing subsequent images. Instead, for 
these embodiments, non-optical motion sensing tech- 
niques that are also well known in the art are used. One 
such method would be to use gyroscopes as described, 
for example, in United States patent 5,825,350, Case, 
Jr. et al., "Electronic Pointing Apparatus and Method", 
which issued October 20, 1998. 
[0016] As will be described below in greater detail, 
control unit 140 causes merge unit 150 to combine the 
motion detection information with the captured image 
and then this merged information is displayed on display 
160. For example, a cursor and a set of icons, such as 
thumbnail images, could be merged with the series of 
images being captured by capture unit 110. Motion of 
the camera 100 would be detected and cause the 
thumbnail images to move within the display. When the 
desired icon moves under the cursor, the user could se- 
lect this target icon by using selection unit 1 70. It is pre- 
ferred that selection unit 1 70 be a switch on the camera 
100. However, other forms of selection, such as voice 
command detection, are known in the art and could be 
employed alternatively. 

[0017] Examples of suitable displays 160 include 
viewfinder micro displays such as are manufactured by 
the MicroDisplay Corporation, San Pablo, California, 
USA, or by Displaytech, of Longmont, Colorado, USA. 
Although it is preferred that display 1 60 be a view finder 
micro display, there are many forms of suitable displays 
such as panel displays that are well known in the art. 
[0018] Figure 2 is a diagram illustrating a digital im- 
aging system having a pointing device-based graphical 
user interface camera according to the present inven- 
tion. In figure 2, camera 100 is shown coupled to exter- 
nal device 210. The coupling can be accomplished us- 
ing wire cable or fiber optic links. The coupling can also 
be accomplished using a wireless link such as infrared 
or radio links. External device 210 can include any of 
the many known external devices that are commonly as- 
sociated with digital cameras such as a computer, ex- 
ternal memory, modem, or printer. It is to be understood, 
however, that digital camera 100 need not be linked to 
external device 21 0 for the present invention to be prac- 
ticed. 

[0019] In figure 2 it can be seen that for this embodi- 
ment, camera 1 00 has a display 1 60 and three selection 
buttons 1 70A, 1 70B and 1 70C. Note that image capture 
unit 180 is shown in figure 2 as being shaded because 
the image capture unit is generally located on the side 
of the camera opposite to the side having the display 
160. 

[0020] For this embodiment, three selection buttons, 
1 70A, 1 70B and 1 70C, are shown. For this example, se- 
lection button 1 70A is used to operate an optical or elec- 
tronic zoom. Buttons 1 70B and 1 70C are used together 
in an application-specific manner. For example, button 
170C can be used to enter a particular mode, such as 
thumbnail image selection. In the thumbnail image se- 
lection mode : button 1 70B can then be used to select a 
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particular thumbnail image when the camera motion 
causes the target thumbnail icon to be moved under the 
cursor. 

[0021 ] Note that this arrangement of buttons makes it 
easy to use camera 100 as a gun-sight-like pointing de- 
vice within a graphical user interface. Digital cameras 
have not generally used pointing devices to interact with 
the interface presented on the display. Typically, they 
use a set of push buttons to step through menus and to 
select images from memory for display and deletion. To 
view a micro display, the user needs to hold the display 
close to his or her eye and view the display through an 
eyepiece. This arrangement makes the interface con- 
trols more difficult to use, because the user will not be 
able to see the controls while viewing the display. 
[0022] The present invention allows the user to inter- 
act with the information display in a way similar to the 
computer mouse. For one embodiment of the present 
invention, the entire body of the camera is moved, and 
the movement of the camera is recorded. The motion 
information can then be used to position a cursor, or to 
position graphic elements. For example, graphic ele- 
ments can be positioned so they stay fixed relative to 
the world as the user moves the camera. 
[0023] With most digital still cameras, the user can 
load a previously captured image to the display by se- 
lecting it from a grid of low-resolution ("thumbnail") im- 
ages. The thumbnail is selected by pressing buttons that 
move a cursor across the thumbnails until the desired 
picture is under the cursor. With the new method, the 
user can look into a micro display and will be presented 
with the thumbnails. A computer within the camera can 
continuously reposition the thumbnails so they appear 
to be fixed relative to the world. The user can then select 
a thumbnail by simply pointing the camera at the desired 
thumbnail. 

[0024] For one embodiment of the present implemen- 
tation, the position of the camera is tracked by optical 
flow. The camera records a sequence of images. By 
comparing the images with each other, the motion of the 
camera can be estimated. Determining the motion of the 
camera by comparing sequential images taken with the 
camera is well described in the literature, and this ap- 
proach has the advantage of not requiring any additional 
hardware. Alternative implementations use sensors 
such as gyroscopes, tilt sensors, compasses, or a GPS 
receiver to measure the position of the camera. These 
solutions may be more robust, but may also be more 
expensive to implement. 

Using the camera like a mouse 

[0025] Figures 3a and 3b illustrate use of the camera 
as a pointing device to select thumbnail images accord- 
ing to an embodiment of the present invention. In figure 
3a, a sheet of thumbnail images is shown superimposed 
on a view through the camera. The cross hair is a cursor, 
and for one embodiment, the cursor is always fixed rel- 



ative to the camera, e.g., the cross hair cursor is fixed 
in the center of the view. The sheet of thumbnail images 
is fixed relative to the world by using motion tracking. 
That is, the computer constantly repositions the sheet 

5 as the camera moves, so the sheet seems to be fixed 
in position relative to the objects seen through the cam- 
era. As shown in figure 3b, when the user moves the 
camera, the cursor moves relative to the world and to 
the world-fixed thumbnails. This allows the user to select 

10 an image by simply pointing the camera at the desired 
image. The camera itself is used as the only pointing 
device. No other mouse, joystick or other device need 
be used to move the cursor. 

15 How it works 

[0026] Figure 4 is a diagram illustrating how the 
thumbnail images of Figures 3a and 3b are made to ap- 
pear to be motionless relative to objects of the scene. 
20 Motion tracking software tracks the motion of image fea- 
tures in the scene. For example, the image of the com- 
puter monitor on the desk moved down and slightly right 
between frame 1 and frame 2. The sheet of thumbnails 
is moved by the same amount, and in the same direc- 
ts tion, as the features in the scene. The sheet thus ap- 
pears to be motionless relative to the objects in the 
scene (such as the computer monitor). 
[0027] Because the thumbnails appear fixed relative 
to the world, the user can use the camera like a gun- 
30 sight. The cross hairs stay fixed relative to the camera, 
and the sheet of thumbnails stays fixed relative to the 
world, so the user can place the cross hairs on the de- 
sired thumbnail by simply aiming the camera. This fea- 
ture provides a very simple to use and intuitive user in- 
35 terface. 

[0028] The viewf inder display may be a micro display 
that is viewed directly through some optics. Such a dis- 
play has inherit advantages over a panel display, be- 
cause it is typically brighter, higher resolution, has more 

40 colors, subtends a larger viewing angle, and requires 
less power. In one viewing mode, the operator of the 
camera can see the display at the same, time as the 
scene. The display can be partially transparent, be op- 
tically mixed with the world by means of a beamsplitter, 

45 or digitally mixed with an image captured with the cam- 
era. 

[0029] In a second alternative mode, the direct view 
of the scene is closed off, perhaps by means of a shutter. 
In this mode only the images on the display can be seen . 

so There could also be other alternative modes where part 
of the scene is masked off, and in these regions only the 
display can be seen. For example, the operator could 
view a mixture of an optical view of the scene with graph- 
ics in the top half of the display, and only graphical status 

55 information against a black background in the bottom 
half of the display. The masking can even be done with 
an electronic element, where the display information 
can be made to appear as an opaque overlay to the op- 
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tical view of the scene. 

[0030] The motion tracking keeps track of the cam- 
era's angular position in the world. As previously de- 
scribed, this can be done by tracking motion using the 
camera's light sensors, or it could be done with other s 
instruments such as a compass, a gyroscope, a GPS 
sensor, or the like. 

Virtual Selection 

10 

[0031 J For one embodiment, the camera is used to se- 
lect positions or regions of the scene. The operator sim- 
ply points the camera at objects or locations in the 
scene, and then uses a button or the like to indicate the 
selection. These regions can then be used to assist in ts 
the capture or processing of the image. 
[0032] Figures 5a and 5b illustrate use of the camera 
as a pointing device to select a portion of the scene ac- 
cording to an embodiment of the present invention. For 
example, a rectangular region that is larger than the 20 
viewfinder of the camera can be selected by marking 
two opposite corners of the region. In this example, the 
selected rectangle is the dotted rectangle of figure 5b. 
The viewfinder is illustrated by the solid rectangle, and 
the cross-shaped cursor is used to select the first corner 25 
of the region in figure 5a, and the second, diagonal cor- 
ner of the region in figure 5b. Note that alternative 
shaped areas can be designated. For example, two 
points could be specified to define a center and radius 
to designate a circular region, or N points could be cho- so 
sen to specify an N-sided polygonal region. 
[0033] Regardless of its shape, the region can be 
used for several purposes. It can delimit the boundaries 
of a region to be captured using multiple tiled images. It 
can be a region that is supposed to receive special 35 
processing, such as reduced image compression to pre- 
serve important details. It can also be used to change 
the zoom, so the camera can capture the framed region 
without any waste due to cropping. 

[0034] Selected locations can be fixed in space by *o 
tracking the camera's movement. Alternatively, moving 
selected targets can be tracked by means such as mo- 
tion tracking. For example, a soccer player's face could 
be selected. Motion tracking would then track the face, 
and the focus could automatically be adjusted to keep *s 
this face in focus. 

[0035] Important scene locations that would aid in im- 
age capture can also be marked. For example, the light 
source can be marked, and this information can greatly 
aid color correction or other image processing. Note that so 
the light source need not be located within the image to 
be photographed. For one embodiment, the photogra- 
pher can collect information for image processing by 
pointing the camera at the light source (or sources), ei- 
ther before or after capturing the image. For an alterna- 55 
tive embodiment, the subject can be marked for auto- 
focus. Areas of the view can also be marked as triggers, 
where image motion in a trigger area will make the cam- 



era take a picture. For example, a tripod-mounted cam- 
era could be set to take a picture if motion is detected 
crossing the finish line of a racetrack. 

Heads-up information 

[0036] As shown in figure 6, a viewfinder display that 
has look-through capability can display information that 
is usually presented on a small status -display. It can 
show the state of the flash, the amount of storage re- 
maining, the degree of compression, and the like. If the 
user requires more information, the cursor can easily be 
moved over the status display to select a more detailed 
display of information. The information is easier to ac- 
cess from the viewfinder display, because it can be seen 
while the picture is being framed. When using the virtual 
selection described above, the heads-up display can 
show the user the region or locations that have been 
selected. Figure 7 is a diagram illustrating use of heads- 
up data during guided swipe of a panoramic scene ac- 
cording to an embodiment of the present invention. In 
this example of capturing a large region with multiple 
tiled images, the camera can show the operator the se- 
lected region (the dashed rectangle), the area of the se- 
lected region that had already been captured (slightly 
darkened), and instructions on which way to point the 
camera to capture the unrecorded parts of the region 
(the left arrow). 

Virtual review 

[0037] With motion tracking and a viewfinder display, 
the operator can be presented with a virtual panorama. 
Figure 8 is a diagram illustrating tracking during virtual 
review of the panoramic scene according to an embod- 
iment of the present invention. After capture and tiling 
to form an oversized image, such as a panorama, the 
user can view the panorama by looking into the view- 
finder. Moving the camera will cause the panorama (the 
dashed rectangle) to move in the opposite direction in 
the camera, thus giving the impression that a large 
scene is being viewed through the window of the view- 
finder (the solid rectangle). The operator will feel im- 
mersed in the panoramic scene. Alternatively, images 
that have more pixels than the micro display can show 
can be displayed. The operator simply moves the cam- 
era to view different parts of the image. 

Image manipulation 

[0038] The combination of a high-resolution colorful 
viewfinder display with a camera permits the camera to 
be used for image manipulations such as cropping, color 
correction and page layout. Figure 9 is a diagram illus- 
trating image manipulation according to an embodiment 
of the present invention. In this example, the cursor can 
be used to adjust the contrast, brightness or hue of the 
selected image by dragging the slider forthe appropriate 
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icon. 

[0039] Figures 1 0a and 1 0b illustrate use of the cam- 
era as a pointing device to select thumbnail images for 
high resolution page layout according to an embodiment 
of the present invention. The cursor is used to select 5 
thumbnail images in Figure 10a. The cursor is then used 
in figure 10b to select a page layout style and to cause 
the resulting image to be sent to a printer for printing. 
[0040] One advantage to performing these operations 
on the camera instead of after downloading the images 10 
to the computer is that the processing can be done be- 
fore image compression. Some operations can also re- 
duce the size of the image, which will thereby reduce 
the storage requirements for the image. For example, 
regions that were discarded when an image was « 
cropped would not need to be stored on the camera. 
Further, this can eliminate the need for an external com- 
puter altogether. The images can be sent directly to the 
printer or other external device. 

20 

Super-resolution and Stereoscopic imaging 

[0041] If the position of the camera is very precisely 
known, a higher resolution image can be synthesized 
from several images taken with slightly different loca- 25 
tions. Also, by tracking the camera's position and pos- 
sibly even guiding the operator to the correct position, 
a second image could be captured at a location that pro- 
vides a good stereoscopic pair to the first image. The 
camera could also be used as a stereoscopic display 30 
device if it had two viewfinder displays. Alternatively, if 
the camera had two capture devices, stereoscopic im- 
ages could be captured more easily, and stereoscopic 
panoramas could be captured. These panoramas could 
be reviewed with stereoscopic viewfinders in the virtual 35 
mode previously described. 

Games 

[0042] By having computer graphics combined with 40 
an optical view of the scene, new types of games would 
be possible. Game elements could be superimposed on 
the view of the scene, and motion tracking of the camera 
could be used to position the elements so they stay fixed 
relative to the scene. For example, a computer graphic 45 
image of a ball could be launched from the camera. It 
could then be made to appear as if the ball had hit an 
object in the scene. The place where the ball had hit 
could be marked with further graphics. 

. so 

Tracking position 

[0043] If the full position of the camera in multiple di- 
mensions is collected, by means of GPS for example, 
this information can be used to automatically record 55 
where and when the picture was taken. Any information 
on the angular position of the camera, the time of day, 
and the geographic location of the camera can also be 



used for color correcting the image. For example, if the 
picture were taken at night,, the camera would not use 
color correction for daylight. Or, if it is known that the 
camera was facing north at 3 pm at a certain location, 
the position of the sun could be determined, and some 
useful characteristics of the sunlight could be estimated 
which would allow improved image processing. 
[0044] The many features and advantages of the in- 
vention are apparent from the written description and 
thus it is intended by the appended claims to cover all 
such features and advantages of the invention. Further, 
because numerous modifications and changes will 
readily occur to those skilled in the art, it is not desired 
to limit the invention to the exact construction and oper- 
ation as illustrated and described. Hence, ail suitable 
modifications and equivalents may be resorted to as fall- 
ing within the scope of the invention. 



Claims 

1. A process for a camera (100) having a display 
(160), the process comprising the steps of: 

displaying a cursor and a plurality of icons on 
the display (160); 

moving the camera (100); 

sensing motion (130) of the camera (100); 

based on the motion, repositioning the icons in 
the display (160) until the cursor is on a target 
icon of the plurality of icons; and 

selecting (170) the target icon. 

2. The process as set forth in claim 1 ; wherein at least 
one of the icons is repositioned to appear to be fixed 
in space with regard to an image being viewed in 
the display (160). 

3. The process as set forth in claim 2, wherein the at 
least one of the icons is repositioned in a direction 
opposite, and of corresponding magnitude, to the 
motion of the camera (100). 

4. A process for a camera (100) having a display 
(160), the process comprising the steps of: 

displaying a cursor and a first portion of a scene 
on the display (100); 

using the cursor to select (170) a first location 
within the first portion; 

moving the camera to display a second portion 
of a scene on the display (160); 
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sensing motion (1 30) of the camera (1 00); 

displaying the cursor based on the motion; and 

using the cursor to select (1 70) a second loca- 
tion within the second portion such that the first 
and second locations define a region of the 
scene, the region being of greater extent than 
is displayed in the display (160). 

5. The process as set forth in claim 4, wherein an op- 
eration is performed on the region and wherein the 
operation includes the step of capturing a paroramic 
image having the extent of the region. 

6. The process as set foth in claim 5, wherein the step 
of capturing the panoramic image includes display- 
ing an indicator on the display (1 60) to guide move- 
ment of the camera (1 00). 

7. A process for a camera (100) having a display 
(160), the process comprising the steps of: 

displaying a first portion of an image on the dis- 
play (160); 

moving the camera (100); 

sensing motion (130) of the camera (100); and 

based on the motion, displaying a second por- 
tion of the image on the display (160). 

8. A camera (1 00) having a display (1 60), the camera 
(100) comprising: 

a motion sensor to sense motion (130) of the 
camera (100); 
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35 



tion within the first portion, and the camera 
(100) is moved to display a second portion of a 
scene on the display (160), the circuitry dis- 
plays the cursor based on the motion so that 
the cursor can be used to select a second lo- 
cation within the second portion such that the 
first and second locations define a region of the 
scene, the region being of greater extent than 
is displayed in the display (160). 

10. A camera (100) having a display (160), the camera 
(100) comprising: 

a motion sensor to sense motion (130) of the 
camera; and 

circuitry to display a first portion of an image on 
the display (160), and if motion of the camera 
(100) is sensed, based on the motion, the cir- 
cuitry displaying a second portion of the image 
on the display (160). 



circuitry to display a cursor and a plurality of <o 
icons on the display (1 60), based on the motion, 
the circurtry repositioning the icons in the dis- 
play (160) until the cursor is on a target icon of 
the plurality of icons; and 



a selector (170) to select the target icon. 

9. A camera (1 00) having a display (1 60), the camera 
(1 00) comprising: 

a motion sensor to sense motion (130) of the 
camera (100); 

a selector (170): and 

circuitry to display a cursor and a first portion 
of a scene on the display (1 60), if the cursor 
and selector is used to select (170) a first loca- 
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is detected (130), and the motion of the camera is used 
to position graphic elements on the camera's own dis- 
play (160). The camera's motion can be detected (130) 
with sensors, such as gyroscopes, or the camera (100) 
itself can be used as a motion sensor. One application 
of this involves using the camera (100) as a computer 
mouse, or like a gun-sight, to select images from a sheet 
of low-resolution ("thumbnail") images. The motion of 
the camera (100) is tracked, and the user aims at the 
desired image from a sheet of thumbnail images. The 
thumbnails appear to be fixed relative to the world be- 
cause the camera (100) can continuously reposition 
them in the display (160) based upon the motion of the 
camera (100). The user can then select (1 70) a thumb- 
nail in an intuitive manner by simply pointing the camera 
(100) at the desired thumbnail. For alternative embodi- 
ments, the interface can be used to select (1 70) regions 
of greater extent than can be viewed in the viewer or to 
virtually review images. 
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